Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem: fee collection not compatible with parallel execution #237

Merged
merged 1 commit into from
Mar 28, 2024

Conversation

yihuang
Copy link
Collaborator

@yihuang yihuang commented Mar 27, 2024

Solution:

  • support an idea of virtual account in bank module, where the incoming coins are accumulated in a per-tx object store first, then accumulate and credit to the real account at end blocker.

    it's nesserary to support parallel tx execution, where we try not to access shared states in tx execution.

Description

Closes: #XXXX


Author Checklist

All items are required. Please add a note to the item if the item is not applicable and
please add links to any relevant follow up issues.

I have...

  • included the correct type prefix in the PR title
  • confirmed ! in the type prefix if API or client breaking change
  • targeted the correct branch (see PR Targeting)
  • provided a link to the relevant issue or specification
  • reviewed "Files changed" and left comments if necessary
  • included the necessary unit and integration tests
  • added a changelog entry to CHANGELOG.md
  • updated the relevant documentation or specification, including comments for documenting Go code
  • confirmed all CI checks have passed

Reviewers Checklist

All items are required. Please add a note if the item is not applicable and please add
your handle next to the items reviewed if you only reviewed selected items.

I have...

  • confirmed the correct type prefix in the PR title
  • confirmed all author checklist items have been addressed
  • reviewed state machine logic, API design and naming, documentation is accurate, tests and test coverage

@yihuang yihuang requested a review from mmsqe March 27, 2024 05:48
x/bank/keeper/virtual.go Fixed Show fixed Hide fixed
@@ -195,6 +197,10 @@
)
}

func (am AppModule) EndBlock(ctx context.Context) error {
return am.keeper.CreditVirtualAccounts(ctx)

Check warning

Code scanning / CodeQL

Panic in BeginBock or EndBlock consensus methods Warning

path flow from Begin/EndBlock to a panic call
path flow from Begin/EndBlock to a panic call
path flow from Begin/EndBlock to a panic call
path flow from Begin/EndBlock to a panic call
path flow from Begin/EndBlock to a panic call
@yihuang yihuang changed the title Problem: no efficient way to collect fee Problem: fee collection not compatible with parallel execution Mar 27, 2024
Comment on lines +188 to +190
for key := range okeys {
cms.MountStoreWithDB(okeys[key], storetypes.StoreTypeObject, nil)
}

Check warning

Code scanning / CodeQL

Iteration over map Warning test

Iteration over map may be a possible source of non-determinism
x/bank/keeper/virtual.go Outdated Show resolved Hide resolved
x/bank/keeper/virtual.go Outdated Show resolved Hide resolved
x/bank/keeper/virtual.go Show resolved Hide resolved
runtime/module.go Show resolved Hide resolved
x/bank/keeper/send.go Outdated Show resolved Hide resolved
@yihuang yihuang requested a review from mmsqe March 28, 2024 02:52
@yihuang yihuang enabled auto-merge (squash) March 28, 2024 03:16
Solution:
- support an idea of virtual account in bank module, where the incoming
  coins are accumulated in a per-tx object store first, then accumulate
  and credit to the real account at end blocker.

  it's nesserary to support parallel tx execution, where we try not to
  access shared states.

more efficient sum

support SendCoinsFromModuleToAccountVirtual

fix test

fix test

fix lint

fix test

fix test

fix test

fix test

fix test

fix mock keeper

try fix lint

try fix lint

reuse code

try fix linter

Update x/bank/keeper/send.go

Signed-off-by: yihuang <[email protected]>

algin panic call

fix error handling

try fix lint

nolintlint generate falst postiive
@yihuang yihuang merged commit 9ef65ec into crypto-org-chain:release/v0.50.x Mar 28, 2024
43 of 45 checks passed
@yihuang yihuang deleted the fee-collection branch March 28, 2024 04:47
zsystm pushed a commit to b-harvest/cosmos-sdk that referenced this pull request May 28, 2024
…cution (crypto-org-chain#237)

Reason for Cherry-pick:
- Migrate Block STM (Parallel Transaction Execution)
- Avoid common conflict problem (fee collection happens for every tx)

Notes for Cherry-pick:
- Use transient store instead of object store introduced by Cronos

Original Commit Message:

* Problem: no efficient way to collect fee

Solution:
- support an idea of virtual account in bank module, where the incoming
  coins are accumulated in a per-tx object store first, then accumulate
  and credit to the real account at end blocker.

  it's nesserary to support parallel tx execution, where we try not to
  access shared states.

more efficient sum

support SendCoinsFromModuleToAccountVirtual

fix test

fix test

* fix lint

* fix test

* fix test

* fix test

* fix test

* fix test

* fix mock keeper

* try fix lint

* try fix lint

* reuse code

* try fix linter

* Update x/bank/keeper/send.go

Signed-off-by: yihuang <[email protected]>

* algin panic call

* fix error handling

* try fix lint

* nolintlint generate falst postiive

---------

Signed-off-by: yihuang <[email protected]>
Cherry-picked-by: zsystm <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants